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(54) Sending/receiving raster/image data via E-mail using a multifunction device 



(57) A method and system fortransferring raster/im- 
age data via a mail user agent (23) using a multifunction 
device (12) and standard Internet mail transfer mecha- 
nisms. An image is acquired in the multifunction device 
(12), the image is attached to an electronic mail mes- 



sage, and then sent in the electronic mail message to 
receiving address(es). Alternatively, an electronic mail 
box is polled by a mail user agent, which identifies those 
received messages with raster/image attachment(s) 
and downloads the attachment(s) to the multifunction 
device for printing, displaying and/or workflow insertion. 
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Description 

[0001] The invention relates generally to transferring 
raster/image data, and in particular to transferring 
raster/image data via Internet mail transfer mechanism. 
[0002] Multifunction devices (MFD) have become one 
of the most common raster/image capture sources. 
Transfer of MFD captured raster/image typically takes 
the form of fax transmissions. It is well accepted that 
transfer via Internet mail transfer mechanism (i.e. email) 
would be more cost effective and would contribute to an 
increase in the transferred quality level. Cost inelasticity 
associated with the commodity based MFD industry, 
however, makes it difficult to absorb the cost associated 
with adding mail user agent (MUA) and mail serverfunc- 
tionality to the MFD. This invention overcomes the cost 
issues by taking advantage of MUAs and mail servers 
that reside in computers and other devices. 
[0003] According to a first aspect of the invention, a 
method of transferring raster/image data via a mail user 
agent (MUA) using a multifunction device comprises 

automatically launching a mail user agent; 

acquiring an image in the multifunction device; 

attaching the image to an electronic mail message 
generated by the user agent; and 

submitting the image for transmission in the elec- 
tronic mail message to a receiving address. 
[0004] According to a second aspect of the present 
invention, a method of receiving raster/image data via 
a mail user agent using multifunction device comprises 
polling an electronic mail box by the mail user agent for 
electronic mail having attachment (s) with predeter- 
mined file extension or MIME content-type; 

optionally parsing other email/MIME header or 
other suitable information to determine if the electronic 
mail with the predetermined file extension or MIME con- 
tent-type attachment is an Internet fax (IFax) image; 

transferring the attachment, optionally including 
the message body, to the multifunction device; and 

automatic printing, displaying and/or downloading 
to a designated workflow process embedded as subsys- 
tems within the multifunction device or accessible via 
direct or network connections. 

[0005] The foregoing aspects and other features of 
the present invention are explained in the following de- 
scription, taken in connection with the accompanying 
drawings, wherein: 

FIG. 1 is a block diagram of a system incorporating 
features of the disclosed embodiments; 
FIG. 2 is a flow chart of one embodiment of a meth- 
od incorporating features of the disclosed embodi- 
ments; 

FIG. 3 is a flow chart of one embodiment of a meth- 
od incorporating features of the disclosed embodi- 
ments; 

FIG. 4 is a block diagram of one embodiment of a 
system incorporating features of the disclosed em- 



bodiments; and 

FIG. 5 is a block diagram of an apparatus that may 
be used to practice the features of the disclosed em- 
bodiments. 

5 

[0006] As shown in Fig. 1, the system 10 generally 
comprises a multifunction device 12 coupled with a mail 
user agent 23 that resides on a computer 1 4, for exam- 
ple a personal computer. The mail user agent 23 gen- 

10 erally comprises an electronic mail application ("email"). 
Although the mail user agent 23 is described as being 
resident on a computer, the mail user agent can reside 
on any suitable device that is directly or network con- 
nected to the multifunction device 12 and has access to 

15 the Internet. The multifunction device 12 and computer 
1 4 can be coupled by a communication channel 18. The 
communication channel 18 can comprise any suitable 
connection for the transmission of electronic data and 
information, such as a hardware connection, an optical 

20 connection or a wireless connection. As shown in FIG. 
1 , the computer 1 4 can be coupled to a network 16, such 
asforexamplethe Internet. In alternative embodiments, 
the system 1 0 could include such other suitable compo- 
nents for both sending and receiving raster/image data 

25 using email transfer mechanisms. It is a feature of the 
disclosed embodiments to transfer raster/image data 
via email to email or Internet Fax ("IFAX") clients by us- 
ing a multifunction device coupled with an email appli- 
cation. Referring to Figs. 1 and 2, the transferring of 

30 raster/image data can generally be accomplished by au- 
tomatically launching the mail user agent 23 as shown 
in step 200. The receiving client(s) destination informa- 
tion is transferred step 202 from the multifunction device 
1 2 to the mail user agent 23. The destination information 

35 can comprise an email address. The raster/image data 
can then be transferred in step 204 from the multifunc- 
tion device 1 2 to the mail user agent 23. The message, 
which is described herein as an email message, will then 
be prepared in step 206 for submission to the Internet. 

40 The mail user agent 23 in conjunction with the computer 
14 prepares the email message for submission. The 
email message can then be submitted in step 208 for 
transmission by an appropriate mail server. 
[0007] In one embodiment, the step of automatically 

45 launching the mail useragent23 can generally comprise 
a user activation of a user interface 24 of the multifunc- 
tion device 12 that captures the intent for sending an 
email/IFAX. The user interface 24 is adapted to allow 
user input of the destination information. The destination 

50 information input can take the form of an email, intranet 
or internet address, or telephone number entry, via a 
combination of keystroke sequences and/or an abbre- 
viated speed/quick dial keystroke entry, which act as ref- 
erence pointers to email address(es) cached in buffers 

55 accessible to the multifunction device 12orthemail user 
agent 23. The "destination address" can be any suitable 
address or destination for delivery of raster/image data, 
including for example a telephone number, an intra or 
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Internet address, or other network location. The multi- 
function device 12 is adapted to signal an email/I FAX 
send request to the mail user agent, whether connected 
directly or via a network. The multifunction device sign- 
aling may be initiated when the user indicates, via the 
user interface 24, that the destination input has been 
completed. 

[0008] The transfer of the destination information can 
be initiated by receipt of an acknowledgement from the 
mail user agent 23. The transfer of the destination infor- 
mation can comprise the multifunction device 1 2 retriev- 
ing the email address(es) cached in buffers accessible 
to the multifunction device 1 2 and referenced by the ab- 
breviated speed/quick dial sequence. This is followed 
by the transfer of the retrieved email address (es) to the 
mail user agent 23. In one embodiment, the transfer of 
the destination information can occu r by transferring the 
abbreviated speed/quick dial sequence to the mail user 
agent 23 and then retrieval, by the mail user agent 23 
of the email address(es) cached in buffers accessible to 
the mail user agent 23 and referenced by the abbrevi- 
ated speed/quick dial sequence. The transfer of desti- 
nation information can also occur by a transfer of the 
email address(es) , which was entered via a combination 
of keystroke sequences, to the mail user agent 23. 
[0009] The transfer of the raster/image data from the 
multifunction device 12 to the mail user agent 23 gen- 
erally comprises activating a subsystem of the multi- 
function device 12, which is adapted to acquire the im- 
ages. The acquisition of the images can comprise initi- 
ating a scan job to acquire the images from the scanner 
within the multifunction device 12 or a scanner accessi- 
ble to the multifunction device, or locating images pre- 
viously stored in buffers accessible to the multifunction 
device 12. It must be noted that the step of initiating a 
scan job may also comprise the step of feeding a doc- 
ument into an automatic document feeder. 
[0010] The captured images can then be encoded 
with attributes suitable for the receiving client or at- 
tributes suitable for transfer of the image to the mail user 
agent 23. The step of encoding can include, but is not 
restricted to, compressing and file formatting. The client 
attributes can in one embodiment have been cached 
within buffers accessible to the multifunction device 12 
or a set of default attributes may be used. The sending 
to multiple receivers with different attribute require- 
ments may be accommodated by making multi copies 
of the images, followed by encoding according to the 
different set of cached attributes. Alternatively, subse- 
quent to the transfer of the encoded images to the mail 
user agent 23, the mail user agent 23 would recode the 
image (s) in accordance with client attributes cached 
within buffers accessible to the mail user agent 23 or in 
accordance with a default set of attributes. The sending 
to multiple receivers with different attribute require- 
ments results in the transfer of only one copy of the im- 
ages across the multifunction device 12/mail user agent 
23 interface. The mail user agent 23 will generate the 



required number of copies in associated encoding prior 
to transmission. 

[001 1 ] The preparation of the email message for sub- 
mission to the Internet would conform to appropriate 

5 IETF (Internet Engineering Task Force) Request for 
Comments (RFC) specifications. This can comprise 
generation of a mail message by the mail user agent 23, 
attaching the formatted image(s) within the email mes- 
sage body and constructing the appropriate message 

10 headers. In one embodiment, a text message may be 
added to the body of the mail message. It must be noted 
that upon receiving such a message, an automatic I FAX 
receiver may or may not render the text message con- 
tained within the message body. 

15 [0012] The submission of the message for transmis- 
sion generally comprises addressing the envelope with 
Internet address(es) of the receiving client(s) and sub- 
mitting the address message via an appropriate simple 
mail transfer protocol ("SMTP") server. In one embodi- 

20 ment, a subject in any appropriate message headertype 
information can be inserted as well. 
[001 3] The multifunction device 1 2 can include for ex- 
ample, a multifunction peripheral device or xerographic 
print/copy system. The images, which can also be re- 

25 ferred to as documents, are acquired 204 by the multi- 
function device 12. In one embodiment, the multifunc- 
tion device 1 2 can include a scanner that can scan the 
images. In alternate embodiments, the images can be 
inputted into the multifunction device 1 2 in any suitable 

30 manner, such as for example, by electronic file transfer. 
Once acquired, the images and job information also re- 
ferred to as the "document" can be transferred 206 to 
the computer 14. The "job information" as referred to 
herein can include, for example, the destination ad- 

35 dress, client attributes, file type and size, and any text 
message or note. 

[001 4] When receiving raster/image data, referring to 
Figs. 1 and 3, the inbox of the mail user agent 23 is au- 
tomatically scanned/polled at predetermined intervals, 

40 step 302. The inbox of the mail user agent 23 is scanned 
for messages that designate raster file attachments. 
These raster file attachments can include Tag Image 
File Format ("TIFF") files that are referenced for use in 
the I FAX standards and are among the most likely des- 

45 ignated attachments. However, in alternate embodi- 
ments any suitable raster file attachment, such as JPEG 
or PDF may be designated. The designated attachment 
(s) may be identified by their file extension(s) and/or 
Multipurpose Internet Mail Extensions ("MIME") con- 

50 tent-type(s). For TIFF files, the file extensions may be 
one of .tif, .tiff, .tiff -fx or any other suitable extension de- 
fined in an appropriate IETF RFC, while the MIME con- 
tent-types may be one of image/tiff or image/tiff-fx or any 
other suitable MIME content-type defined in an appro- 

55 priate IETF RFC. A copy of the designated attachment 
(s) can be transferred 304 to the multifunction device 
12. The file wrapper(s) are unwrapped and the attach- 
ments are decompressed 306. Alternatively, file wrap- 
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per removal is performed prior to transfer. It is also con- 
ceivable that re-coding, to a set of encodings that are 
more suitable for transfer, will occur prior to the transfer 
to the multifunction. The transferred attachment, and 
optionally the message body, can then be processed for 
printing and/or displaying via the multifunction device 12 
printing subsystem or any suitable printer or accessible 
display. In an alternate embodiment, the attachment can 
also be received and downloaded in any suitable man- 
ner, including for example, an electronic file transfer, for 
workflow insertion or displaying/printing at an appropri- 
ate time. 

[0015] Referring to Fig. 4, in one embodiment, a mul- 
tifunction device 42 does not need to be connected to a 
computerto send or receive raster/image data. This em- 
bodiment can be referred to as a stand-alone mode. In 
this mode, the multifunction device 42, similarto device 
1 2 of Fig. 1 , is adapted to connect to an Internet service 
provider or some form of network based service 44. The 
connection 48 can be established by any suitable 
means, including, for example, a dial up connection, IS- 
DN connection or DSL connection. Once the connection 
48 is established between the multifunction device 42 
and the service 44, the raster/image data and destina- 
tion information can be sent or transmitted as described 
herein. 

[0016] In one embodiment, the multifunction device 
1 2 of Fig. 1 can include a button or activation device 26 
that is adapted to cause the multifunction device 12 to 
send or receive raster/image data automatically. The 
button 26 can comprise a switch located on a control 
panel of the multifunction device 12 or a "soft button" 
associated with a software program or application. In an 
alternate embodiment any suitable switch can be used. 
By activating the button 26 the user can send an I FAX 
from the coupled multifunction device 12 or automati- 
cally check all unopened received electronic mails for 
designated files or attachments. A designated file type 
and any associated email note can be downloaded or 
reproduced by the multifunction device 12. In one em- 
bodiment, the multifunction device 1 2 comprises a print- 
er or any suitable display/rendering device. 
[0017] Referring to Fig. 1 , activation of some form of 
an Internet function/button or device 26 can cause the 
multifunction device 12 to automatically address and 
send the raster/image data to a designated receiver or 
prepare a message including raster/image data for man- 
ual addressing and sending by the user. Generally, the 
raster/image data transfer application can be invoked or 
activated by activating some form of an Internet button 
or key, or key combination that is defined on the multi- 
function device. The user can then be prompted to load 
ortransferthe document or image to be sent by the mul- 
tifunction device. If the document or image is not in an 
electronic form this can include placing the document in 
a scanner device that is part of or attached to the mul- 
tifunction device. Where a scanner is used, the raster/ 
image data can be captured via, for example, a 



TWAINTM driver supplied with the multifunction device. 
The captured image can be encoded with a suitable set 
of encodings. The encoding method can include the 
TIFF-FX (IETF RFC 2301 or future replacements there 
5 of) S-profile for black/white documents and the TIFF-FX 
C-profile for color documents. In alternative embodi- 
ments, any suitable set of encoding standards or meth- 
ods can be used. 

[0018] Activation of the Internet function can also 
10 cause the user's electronic mail user agent to open. This 
can include automatically opening a blank email note. 
The image can be acquired by the mail user agent from 
the multifunction device and attached to the email note. 
This can include acquiring a scanned image from the 
15 attached multifunction device scanner using predefined 
image capture criteria. The scanned image can be en- 
coded appropriately and attached to the blank email 
note. 

[0019] In one embodiment the features of the dis- 
20 closed embodiments could include or be incorporated 
in a WindowsTM based application or software that is 
adapted to automatically send and receive raster/image 
data using a multifunction product or device. 
[0020] The present invention may also include soft- 
25 ware and computer programs incorporating the process 
steps and instructions described above that are execut- 
ed in different computers. In the preferred embodiment, 
the computers are connected to the Internet. Fig. 5 is a 
block diagram of one embodiment of a typical apparatus 
30 incorporating features of the present invention that may 
be used to practice the present invention. As shown, a 
computer system 50 may be linked to another computer 
system 52, such that the computers 50 and 52 are ca- 
pable of sending information to each other and receiving 
35 information from each other. In one embodiment, com- 
puter system 52 could include a server computer adapt- 
ed to communicate with a network 54, such as for ex- 
ample, the Internet. Computer systems 50 and 52 can 
be linked together in any conventional manner including 
40 a modem, hard wire connection, or fiber optic link. Gen- 
erally, information can be made available to both com- 
puter systems 50 and 52 using a communication proto- 
col typically sent over a communication channel or 
through a dial-up connection on ISDN line. Computers 
45 50 and 52 are generally adapted to utilize program stor- 
age devices embodying machine-readable program 
source code, which is adapted to cause the computers 
50 and 52 to perform the method steps of the present 
invention. The program storage devices incorporating 
50 features of the present invention may be devised, made 
and used as a component of a machine utilizing optics, 
magnetic properties and/or electronics to perform the 
procedures and methods of the present invention. In al- 
ternate embodiments, the program storage devices may 
55 include magnetic media such as a diskette or computer 
hard drive, which is readable and executable by a com- 
puter. In other alternate embodiments, the program stor- 
age devices could include optical disks, read-only-mem- 



25 



30 



35 



40 



45 



50 



4 



7 



EP 1 445 936 A1 



8 



10 



Internet fax (IFax) image; 
transferring the attachment, optionally includ- 
ing the message body, to the multifunction de- 
vice; and 

automatic printing, displaying and/or down- 
loading to a designated workflow process em- 
bedded as subsystems within the multifunction 
device or accessible via direct or network con- 
nections. 

3. The method of claim 1 wherein the step of automat- 
ically launching the mail user agent comprises: 

user activation of a multifunction device user in- 
15 terrace, which may include a designated button 

or soft switch, that captures intent for sending 
raster/image data via the Internet; 
user input of destination information via the us- 
er interface; and 
20 issuing by the multifunction device of some 

form of activation signal, to a computer or any 
other appropriate device containing an appro- 
priately configured mail user agent, which acti- 
vates the mail user agent. 

25 

4. The method of claim 3, wherein the step of user in- 
put of destination information comprises input of 
destination information via the user interface of the 
multifunction device orthe mail user agent, wherein 

30 destination information entry at the multifunction us- 
er interface is in the form of email/Internet address 
entered via a combination of key stroke sequences, 
and/or abbreviated speed/quick dial sequences 
which reference email/Internet addresses cached 

35 in buffers accessible to the multifunction device or 
the mail user agent. 



ory ("ROM") floppy disks and semiconductor materials 
and chips. 

[0021 ] Computer systems 50 and 52 may also include 
a microprocessor for executing stored programs. Com- 
puter 50 may include a data storage device 56 on its 
program storage device for the storage of information 
and data. The computer program or software incorpo- 
rating the processes and method steps incorporating 
features of the present invention may be stored in one 
or more computers 50 and 52 on an otherwise conven- 
tional program storage device. In one embodiment, 
computers 50 and 52 may include a user interface 57, 
and a display interface 58 from which features of the 
present invention can be accessed. The user interface 
59 and the display interface 58 can be adapted to allow 
the input of queries and commands to the system, as 
well as present the results of the commands and que- 
ries. 

[0022] The features of the disclosed embodiments 
generally provide for allowing a user to use a multifunc- 
tion device, such as for example a xerographic system, 
to send and receive raster/image data. The disclosed 
embodiments allow a user to automatically send raster/ 
image data from a multifunction device via a simple and 
user friendly interface. All received emails can be auto- 
matically checked for designated raster/image file at- 
tachments and automatically printed/displayed or down- 
loaded as appropriate. 

[0023] In other alternate embodiments, the mail user 
agent 23 functionalities as described above may be im- 
plemented in some form of network based service 16 
/54 or an Internet service provider 44. 



Claims 

1. A method of transferring raster/image data via a 
mail user agent (MUA) using a multifunction device 
comprising the steps of: 

automatically launching a mail user agent; 
acquiring an image in the multifunction device; 
attaching the image to an electronic mail mes- 
sage generated by the user agent; and 
submitting the image for transmission in the 
electronic mail message to a receiving address. 

2. The method of claim 1 further comprising the steps 
of: 

polling an electronic mail box by the mail user 
agent for electronic mail having attachment (s) 
with predetermined file extension or MIME con- 
tent-type; 

optionally parsing other email/MIME header or 
other suitable information to determine if the 
electronic mail with the predetermined file ex- 
tension or MIME content-type attachment is an 



5. The method of any of the preceding claims wherein 
the step of attaching the image to an electronic mail 

40 message further comprises the steps of: 

transferring the image and destination address 
to the mail user agent; 

optionally copying and/or re-encoding the im- 
45 age, by the user agent, to accommodate send- 

ing to multiple destinations and satisfy attribute 
profiles cached by the mail user agent or down- 
loaded via network services; 
automatically opening a blank electronic mail 
50 message in the mail user agent; 

automatically attaching the encoded image(s) 
to the blank electronic mail message. 

6. The method of claim 5, wherein the step of trans- 
55 ferring destination information comprises: 

retrieval, by the multifunction device, of any 
email address(es) referenced by speed dial/ 
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quick dial sequences and cached in buffer ac- 
cessible to the multifunction device, followed 
by; 

transferring the destination information, includ- 
ing email addresses and/or speed/quick dial 5 
sequences, for which email addresses are 
cached in the mail user agent and will be re- 
trieved following transfer, to the mail user 
agent. 

10 

7. A method of receiving raster/image data via a mail 
user agent using multifunction device comprising: 

polling an electronic mail box by the mail user 
agent for electronic mail having attachment (s) 15 
with predetermined file extension or MIME con- 
tent-type; 

optionally parsing other email/MIME header or 
other suitable information to determine if the 
electronic mail with the predetermined file ex- 20 
tension or MIME content-type attachment is an 
Internet fax (IFax) image; 
transferring the attachment, optionally includ- 
ing the message body, to the multifunction de- 
vice; and 25 
automatic printing, displaying and/or down- 
loading to a designated workflow process em- 
bedded as subsystems within the multifunction 
device or accessible via direct or network con- 
nections. 30 



1 0. A computer program product storing computer code 
for carrying out a method according to any of the 
preceding claims. 



8. The method of claim 7 wherein the step of polling 
further comprises the step of: 

automatically checking each electronic mail in 35 
the mail box at a predetermined interval; and 
examining each unread electronic mail mes- 
sage for attachment(s) of designated file exten- 
sion or MIME content-type, or any other appro- 
priate header information, which may desig- 40 
nate an IFax or email message appropriate for 
automatic processing. 

9. The method of claim 7 or claim 8 wherein the step 

of transferring further comprising the step of: 45 

extracting the attachment(s) from the mail mes- 
sage; 

optionally re-encoding the attachment(s) to a 
form more suitable for transferto the multifunc- 50 
tion; 

transferring the attachment(s), and optionally 
the associated message body, to the multifunc- 
tion; 

decoding the attachment(s). including but not 55 
limited to unwrapping of the file format and de- 
compressing the image(s), in preparation for 
printing, displaying and/or workflow insertion. 
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